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FOREWORD 



This report des cr ibes the develop ment and testing of a self-instructional training 
program for teachingTumor registrars the^^ocedures for abstracting the medical cHarts of 
cancetr ^>atientsrr The r program is designed for use :with high schoQl graduates with no 
previous medically related experience. 

Development of the program was sponsored by the Louisiana Regional Medical 
Program, Joseph F. Sabatier, M.D., Director. Project approval was received in 1969. Work 
began on program development in the Spring of 1970; testing of the program was 
completed in February 1972. ^ 

The prime contractor for the project was the Tumor Registry of Charity Hospital, 
New Orleans, Louisiana. This registry is under the supervision of Edward Krementz, M.D.,^ 
Chairman of the Tumor Registry Board, and Head, Section of Oncology, Tulane Univer- 
sity Medical School. The Charity Hospital registry is a participant in the End Results 
Evaluation Program, a program sponsored and supported in part by the National Cancer 
Institute, U.S. Department of Health, Education and Welfare (DHEW). 

The technical consultant for the program was Robert F. Ryan, M.D., Professor, and^ 
Head, Section of Plastic Surgery, Tulane University Medical School. Dr. Ryan technically 
reviewed the training material developed for the program. In addition, he supervised the 
establishment of project facilities in New Orleans, provided guidance for the design and 
development of -the program, and guided program coordination with the Louisiana 
Regional- Medical Program and the End Results Section of the National Cancer Institute, 
and with other tumor registries in the United States. 

Considerable technical support in the form of reviews of draft instructional material 
and material for the Tumor Registrar Handbook was provided by Miss Brent S. Robert- 
son and Mrs. Jane Roberts, Director and Computer Liaison respectively of the Charity 
Hospital Tumor Registry. 

Development and test of the program was coordinated by Mr. CO. Renick, Jr. Mr. 
Renick coordinated contractor and subcontractor activities in the New Orleans area. In 
addition he gathered background information and training chart material for the program; 
coordinated review of the instructional material; administered the program during its 
initial field test; maintained project records, prepared progress reports, and so on. 

Much of the instructional material was developed by the Human Resources Research 
Organization, the subcontractor for the project. When appropriate, explanatory material 
was taken from the **End Results Group 1967 Code Manual" prepared by the End 
Results Section, National Cancer Institute. Additional explanatory material was obtained 
from the Procedures Manual for Cancer Registries of the Georgia Regional Medical 
Program and from the California Tumor Registry Handbook. 

The course was designed and developed under the technical direction of C. Dennis 
Fink, Ph.D., Program Director, HumRRO Division No. X (now the Eastern Division), 
Alexandria, Virginia. Dr. Fink prepared considerable portions of the course material, assisted 
by Richard D. Behringer, Ph.D., and Mrs. Judith C. Pumphrey. Dr. Behringer prepared most 
of the material for Instructional Packages 6 and 7, which deal with the procedures for 
describing the extent of disease of a malignant tumor. Mrs. Pumphrey coordinated the many 
activities associated with the editorial review and assemblage of the course instruc- 
tional packages. 

In addition to the support and encouragement provided by the Louisiana Regional 
Medical Program, technical assistance, counsel, and information were provided by persons 



associated with the Regional Medical Programs Service, Health Services and Mental Health 
Administration (DHEW); the End Results Section, National Cancer Institute, National 
Institutes of Health, DHEW; the Rocky Mountain States Cooperative Tumor Registry, 
Salt Lake City, Utah; the Tumor Registry Training Program, Cancer Research Institute, 
University of California, San Francisco; the Georgia Regional Medical Program; and 
individuals associated with txmior. registries in the Washington, D.C, area. New York City 

area, and the State o f Louisiana, ^ ^ 

' Funds for Tevismg the draft program oTTTKeTSasis of Its initial lield-test were -ncrt— ^ 
rforthcQming 4>ecause.^mpha$ii^4n^ Medical Program .wa& shifted away from 

cancer-related activities. Therefore, the draft program as discussed herein is not available 
for distribution. This report has been published because it contains methodological 
information of interest to anyone who might wish to develop and field-test draft training 
program material. 



Meredith P, Crawford 
President 

Human Resources Research Organization 
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SUMMARY AND CONCLUSIONS 



PROBLEM 

The training program described herein was developed in part because of the desire of 

the Louisiana Regional Medical Program to- promote the e&tabiishment^f^-a-&tate-wide 

registry system within, the state oL Louisiana. A major impediment to the establishment 
of this system was the lack of a suitable training program for tumor registrars. Until the 
development of the present program, tumor registrars and their assistants were trained by 
traditional lecture and workshop techniques and by on-the-job training. Instruction often 
was provided by medical doctors who seldom had much time to devote to the training of 
^ tumor registrars. 

Tumor registrars often are operated by persons who have received little or no 
previous training in a medically related area. These persons must learn the medical 
vocabulary associated with the diagnosis and treatment of cancer. In addition, they must 
learn a fairly comphcated set of rules for abstracting the medical chart of a cancer 
patient. ^ ^ 

APPROACH TO COURSE DESIGN 

The original intent in developing this training program was to teach the medical 
vocabulary required of tumor registrars. The program as eventually constructed included ^ 
the teaching of the abstracting and coding procedures developed by the End Results 
Section, National Cancer Institute. 

The training program was designed to be completely self-contained and to be 
administered as a correspondence course. The instructional mate^rial was contained in ten 
instructional packages. Each package contained a criUTion examination. Distributed with- 
certain instructional packages were reference aids and job aids judged to be critical to the 
successful performance of a tumor registrar. Extensive use was made of self-scoring 
practical exercises during which a student abstracted from all or portions of 15 training 
medical charts which were distributed with the program. The student was provided with a 
Tumor Registrar Handbook containing a variety of job aids of use to a tumor registrar. 
The use of these job aids was taught during the program. 

Some of the major topics taught in the program include the purposes and products 
of a tumor registry, the procedures for establishing a tumor registry, general procedures 
for coding information contained on a tumor registry abstract, the general types of fih\s 
established and maintained by a tumor registry, and the detailed procedures for abstract- 
ing the chart of a cancer patient. Various sections of the program concentrated on 
teaching the medical vocabuhiry required to abstract the medical chart of a cancer 
patient. A general overview of lU body systems was provided, with emphasis placed on 
learning the location of the various parts and organs that comprise each system. 

TRAINING PROGRAM TRYOUT AND EVALUATION 

The program was administered to 33 persons, 31 of whom were employed at 25 
hospitals located throughout the state of Louisiana. Two students were employees of the 
Louisiana Blue Cross. Most of these students wero^ot familiar with the operation of a 
tumor-registry. Many were persons who work in the Records Department of a hospital. 



but who were quite unfamiliar with the vocabulary associated with the diagnosis and 
tres^tment of cancer. Twenty-five students received a payment of $500 for taking the 
course; these students provided comments and suggestions regarding how the course could 

The training program was evaluated in terms of the criterion test scores for each of 
r the ten instructional packages. The results showed that on eight of ten criterion tests, at 
least 75% of the students obtained a score of 65 or higher. ThO criterion test scores for 
two instructional packages were, on the average, lower than desirable; examination of 
student comments and discussions with the students revealed that these low criterion test 
scores were due primarily to the use of an unusually difficult training chart in these tests. 
The average student required 145 hours to complete the training program. 

CONCLUSIONS AND RECOMMENDATIONS 

The training program, in its present form, was judged to be effective. It can teach 
persons with little or no medical training to abstract the medical chart of a cancer patient 
in accordance with abstracting/coding rules promulgated by the End Results Group of the 
National Cancer Institute. 

However, additional work is recommended before the program is released for general 
availability. It is recommended that: 

• Improved mat<>rial be develope^d for those portions of the program that, as 
indicated by criterion test scores, had instructional inadequacies. 

• The program be reviewed by a .select group of persons knowledgeable with / 
respect to Knd Results (Iroup abstracting f)rocedures in order to fully assure 
that the program is in accordance with these procedures. 

' • The program be reviewed by agencies such as the American ('ancer Society 
and the American College of Surgeons in order to ensure its widespread 
acceptability within the medical community. 

• A final version of the training F)r()gram be prepared, incorporating the 
. recommendations of the various review (M)mmittees and / instru<aional 

improvements as suggested by> students of the experimental |ersion of the , 
program. ^ 

• The training program be made available throughout the United States. 

4 
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Chapter 1 

REOUIR€MENTS FOR AND OBJECTiVES OF THE 
TUMOR REGISTRAR TRAINING PROGRAM 

V '^'^ ■ ■- 

TRAINING REQUIREMENTS FOR A TUMOR REGISTRAR 

A considerable portion of the existing information on incidence of cancer and on 
the effects of various types of treatment for cancer is based on data obtained from tumor 
registries. Most tumor registries are located at individual hospitals. About 900 registries 
currently exist in the United States. The major activities conducted at these registries 
include abstracting the medical chart of q cancer patient, determining the post treatment 
status of former patients, providing assistance to help ensure the periodic checkup of 
former'^patienls, and 'preparing statistical reports based on tumor registry data. 

Most registries exist for the purpose of providing information to the physicians who 
practice at a particular hospital. Within some states, counties, and geographical regions, 
individual registries have been organized into registry systems. These systems have been 
supported, at least in part, by the Regional Medical Program Services (RMPS), a division 
oi the Health Services and Mentat Health Administration, A small number of individual 
registries and state registry systems are supported in part by the End Results Section 
(ERS) of the National Cancer Institute (NCI). These* registries and registry systems 
provide data to- the NCI for epidemiological research purposes, 

A tumor registry is operated by a tumor registrar. At large registries the registrar is 
assisted by one or more abstractors, coding clerks, and patient follow-through clerks. The 
tumor re^strar may hjw^ received training as a medical records librarian or as a medical 
secretary, or mijy ha\fe^ AA 'or BA, degree in one of the biological sciences. It is quite 
common, . h<>wever, for a registrar to have received ' no form^al Biological or luedical 
training; assistants are even less likely to have had such training. 

Tumor registrars and their assistants have customarily been trained by traditional 
lecture and workshop tech.niques and by on-the-job training. Instruction ^ generally was 
provided by medical doctors who seldom had much time to devote to training registry 
personnel. 

The only formal trainiirg program in existence as of January 1972 is that operated 
by the Tumor Registry, Cancer Research Institute, University of California, San 
Francisco. The training program is primarily suited to persons who already have some 
experience at operating a tumor registry. Trainees are required^to live at the training site 
from one to four weeks. The enrollment capacity for the program is limited; in addition, 
few hospitals are aBle, or willing, to provide the funds to support their tumor registty 
personnel while away on a training assignrfient. 

The training program described in this report was developed^in patt Jbecause of the 
desire of the Louisiana Regional Medical Program to promote the establishment of a 
statewide registry system within the State of Louisiana. A major impediment to thp 
establishment x)f such a" system was the lack of a suitable training program for tumor 
registrars. A survey of hospital' personnel, and conditions within the state indicated that 
procedures would have to be developed for training persotis employed at small hospitals 
located throughout the state, much of this training would have no close monitoring, and 
the training would have to take place at the trainees' work site or in their home setting. 

11 



These were the major reasons for supporting the development of a self-instructional 
training program, similaf^toTa^correspondence course, for tumor registrars. 

OBJECTIVES OF THE TUMOR REGISTRAR TRAINIIsIs PROGRAM 

The original goal of the training program was to t^h the medical vocabulary 
required trf tumor-registrars. Early in^ the^ development of tticWpgr^/ it -was decided to^ 
expand the ^intent to include and to emphasize the teaching of the Epd Results Gi^pup 
(ERG) abstracting/coding procedures. These procedures are employed at registries^ 
supported in part by the End Results Section, National Cancer Institute, 

A training program must distinguish between activities which the trainee will be 
taiffiht to perform at a journeyman level of proficiency and activities with which the 
trainee will be familiarized. This latter set of activities includes those which the trainee is 
told about, and may even acquire considerable knowledge about, but still cannot perform 
skillfully. In the present training program those activities taught to at least a minimally 
acceptable level of proficiency included: 

(1) The identification and selection of charts that should be incorporated into 
tumor registry files. • 

(2) The preparation of tumor registry abstracts in accordance with End Results 
Group procedures. 

(3) The proper utilization of a small number of standard references and jdb 
aids judged to be critical to the satisfactory performance of a tumor 
registrar. 

(4) The preparation of a follow-through record for present and former cancer 
patients. 

(5) The ability to satisfactorily define and/or utilize the standard medical 
vocabulary and abbreviations found in the chart of a cancer patient. 

It should be emphasized that the training goal of this program is to prepare students 
so that they can apply ERG abstracting procedures to the filling out of a tumor registry 
abstract form. During the Instruction many abstracting rules and procedures are 
memorized by the student. However, the goal is not to train a student ^^J^e point where 
all these rules are memorized but to emphasize using the Instrucfi|)nal Material for 
reference. The training goal, therefore,, is to prepare students who {ht^ reliably and 
accurately abstract a medical chart by using the Instructional Package material and other 
reference aids provided during the course*-^ 

The training program that was developed introduced the trainee t% practically all of 
the purposes, activities, and potential products of a tumor regisfty. In many instances 
these were discussed within the self-instructional packages. In other instances the trainees 
were provided with reference articles dealing with some aspect of the establishment or 
operation of a tumor registry. Some of the more important topics to which the trainees 
'^ete introduced were: 

(1) The purposes of a tumor registry. 

(2) The products of a tumor registry. 

(3) The procedures for establishing a tumor registry. 

(4) The general procedures for coding information contained in a tumor 
registry abstract. 

(5) The general types of files established and maintained* by a tunior registry. 



Chapter 2 

GENERAL CHARACTERISTICS OF THE 
TUMOR REGISTRAR TRAINING PROGRAM 

TRAlNlNdl PROG RAA/I. FORM AT 

The training program was designed to be completely self-contained and to be- 
administered as a correspondence course. One of the basic features of a correspondence 
course is that it contain^ examinations that can be returned to a central location for 
scoi^g, with answers and commeiats returned to 'the student with the next block of 
instructional niateriM. If desired, such procedures can ^ec^rfxied on within an individual 
hospital; thjat. is^ a member, of the hospital staff carToe, assigned to administer the 
• corresponde|nce course, \8cbre the -examinations with a scoring key prepkred for the 
program, apd return the scored examination, with appropriate comments, to the student 
with the n^^t instructibhal package. ' . 

^ The basic characteristics of the tumor registrar training program are as. foUows.'r 

(1) The instructional material is contained in 10 instructional packages. Each 
package contains an appropriate .criterion examination, (The table. of contents for Instruc- 
tional Paol^ge #1 is contained in Appendix A of this .report.) 

>(2) Reference aids and job aids judged to be critical to successfuf job per- 
forniiance are distributed wfth certain instructional packages, portions of the mstructional 
packages are designe(^ to teach the proper use of these job aids, ' 

(3) Portions of the instrucxiional materiad, especially on medical vocabulary; are 
presented in a programed . instructional format* Other bloQks of iri$truction present fairly 
large chuilks of instructional material foUo^j^^d by one or more practical exercises. 

j[4) All programed instructional material is in a linear format. That is, no 
attempt is made to return the student to rengiedial blocks of instructional material when 
the student* makes an error. Some of the procedures employed to ^rrect student errors 
are discussed later in this report. * . . ^ ^ 

(5) .Exifenslve use is made of self-scoring practical exercises. With most of these 
exercises; inslfructional comments provide additiotial information to the students on 
applying the abstracting rules taught during the program. The use of a standard set of 
instructional comments is one technique for providing information to correct potential' 
student errbrs/ ^ 

(6) Most of the practical exercises are specUSally related to filling in one or 
more items on the detailed tumor registry, abstract developed for the program. 

(7) The student is providecL^nth a Tumor Registrar Handbook^^containirij^ a 
variety of job aids. The use of these^ job aids is taught during the program. 

^ (8) Fifteen separate medical charts are distributed with the training pro-am. 
Most of these charts a^e complete copies of medical charts selected from Charity 
Hospital, New Orleans. Patient and doctor identification"^ has been removed from these 
training charts, and in some instances fake patient identification has been substituted. 

TECHNIQUES FOR EVALUATING STUDENT PERFORMANCE 

The training program makes extensive use of two general types of student evaluation 
procedures---self-diagnostic tests for use by the students and criterion tests that are scored, 
and evaluated by a program coordinator. 
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One of the key characteristics of programed .instruction is that it continually 
provicies trainees with a . means for assessing their o,ym perfgrmangje. In the present 
program, a short block^of instruction^ material is followed by ^ question that requires 
the student to demonstrate an understfandirij of the material; Th|B student compares his 
answer with a correct answer g^en in some^^easy-to-find location in the instructional 
package. When he cannot answer the questions correctly, the student is instructed^ to 
restudy appropriate portions of the instruction. With this teqhnique^ the student is 
continually informed of his progress in the course. \ ,i ' ^ 

The training program makes extensive use of practical exercisfes located at the end of 
liiajor blocks of instruction. Many of these exercises require the student to abstract 
portions of - a medical chart of a specific diagnostic or treatment report. Answers, plus 
instructional comments for the practical exercises, are located in a separate section of. 
each instructional package. The use of self-corrected practical exercises provides the 
student with a means for evaluating his response tb each exercise. This instructional 
procedure is especially, useful for indicating to the student his ability to apply what he 
has just learned. ^ , ' ♦ ' 

, The criterion test developed for each instructional package is scored By a program 
coordinator. For each question a correct answer was prepared along with comments 
explaining why certain portions of each answer should have been prepsared* in a certain 
way. These** instructional comments provide a, review of material previously presented. In 
addition, they help the. student generalize the instructional material to al^stracting situa- 
tions that may be difficult' to handle. 

The criterion test answers prepared by the trainees, and the correct answers and 
instructional comments pertaining to the test questions, are returned to the trainee. This 
proyides another means for each student to assess his ability to appropriately abstract 
medical charts, 

» 

TECHNIQUES FOR EVALUATING PROGRAM EFFECTIVENESS 

During the development of a training program, not only the performance of the 
experimental student but the program itself must be evaluated: In fact, for a new 
program it is more important to evaluate the program itself. The present training program 
,was extensively, evaluated by the students, and by /the program developers and the 
technical consultants. Before the program is prepared in final form, it should be evaluated 
by a selected group" of reviewers. 

Student Evaluation of the Program 

Twenty-five of the trainees of this experimental program received a stipend of $500. 
For this payment they were asked to record in detail their comments on any portions of 
the program that They found difficult or confusing^^^These coiftments will be used to 
identify portions of the program in need of modification. 

Sttident comments covered such topics as: ^ ^ 

^ • Spelling eiarors and missing material. V 

• Instructional material that was difficult to comprehend. 

• Instr\ictional material that seemed to conflict with material presented in 
other sections of the program. 

• Confusing/inappropriate illustrations and practical exercises. 

• DisagreeiVients regarding answers to practical exercises and criterion test 
questions. 

• Practical exercise material that was illegible, generally because of difficulty in 
reproducing- chart material. 



* • Time required to study each section of an instructional package. 
• Time :fequired to complete each section of a criterion test. 
The primary goal of a training program should be to produce graduates who can 
perform satisfactorily. The program should be for the benefit of the student, designed to 
shape student behavior expeditiously and straightforwardly*^^ is quite appropriate, 
therefore, to allow the student considerable say in iji^lTmying those portions of the 
program in need of revisionrThe trainees of the pipent program did provide a wide 
variety of comments that should prove useful for impdoving the instructional material. 

Use of Criterion Test Scores For Program Evaluations 

On the criterion test developed for each of the 10 instructional packages, student 
afiswers were forwarded to the project coordinator who scored the test, evaluated the>^ 
performance bf each student, and returned the examinations, with appropriate comnientSj 
to the student. With respect to the end performance of the students, a program can be 
judged . successful if the students can .perform . satisfactorily 911 an appropriate criterion 
test. . 

For this training program the final behavior of the trainees can be specified (juite 
accurately—it is to abstract the medical chart of a cancer patient in accordance with End 
Result Group abstracting/coding procedures. A considerable portion of the criterion test 
questions arc designed to assess whether the student <:an correctly complete certain 
portions of a tumor registry abstract. It is Expropriate, therefore, to regard the training 
program as a success to the extent that it prepares trainees to abstraict a medical chart 
successfully. The criterion test results will be presented later in this report; It will suffice 
.to say at this point that these resuljbs-in^^cate that the training program is successful. 

Evaluation by Technical Experts . \ 

- This training program must be evaluated, in part, in terms of whether the instruc- 
tional points and abstracting procedures taught inuring the program are judged to be in 
agreement with those promulgated by the End Results Group of the National Cancer 
Institute. The program was developed and reviewed by the consultants in accordance with 
this general requirement. It is rarely possible, however, to develop a completely satis- 
factory first draft of a training program. 

The first draft of this program has been reviewed by^^me contractor^ersonnel to 
' identify sections of tbft program that needed to be changed to improve medical accuracy 
or to agree more closeW with ERG procedures. The second draft of the instructional 
program has beens^^^rgj^ed in accordance with the results of the above review. In 
particular, medically incorrect statements have been corrected^ 

There are, however, certain portions of the program that still need to he more 
closely examined to determin^^hether they are in agreement with the latest interpreta- 
tion of ERG procedures. Also, it would be most appropriate if the program, before being 
printed in final form, were reviewed by interested agencies such as the American Cancer 
-T>^ociety, the Anierican College of Surgeons, and especially, the End Resultsf Group. 
Suggestions provided by these reviewers then can be incorporated into the final training 
pragram. ^ 

TRAINING PROGRAM ADMINISTRATIVE PROCEDURES 

• / 
The general procedures for administering the training program are as follows: 

(1) Instructional Package 1 is forwarded to the trainee. This package contains 
instructions on /how to study the instructional material, and on how to answer and then 
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•return the criterion test to the Training Program Coordinator. It is suggested that the 
trainee take no more than two weeks to study the instructional material and return the 
criterion test. Preferably, the trainee will be given two-three hours per day, during 
working hours, for study. * 

(2) The criterion test is completed by the trainee and then returned' to the 
program coordinator. ' . ^ 

(3) The program coordinator scores the criterion test and returns it to the 
student along with a set of standard comments that explain the answers to the criterion 
test. These comments were developed as part of the instructional' program. 

(4) It takes 15 to 3,0 minutes to grade a single criterion test. More time would 
be required if comments are provided which are specif ftally related to each student's 
answers. This preferred commenting pr9cedure is too time consuinir^ when administering 
the course to targe numbers of students. 

(5) The next instructional package is forwarded to the trainee along with the 
answers and comments to the criterion test for the previous instructional package. 

^6) This- cycle continues until all instructional packages have been distributed 
to the trainees. 

(7) The Tumor Registrar Handbook, along with appropriate tabs for the 
various Handbook sections, is distributed to the student wrth Instructional Package,!. 
Sections of the Handbook are sent out with the various instructional packages of the 
program. Each section of the material is distributed .with the particular instructional 
package to which it first applies. 

(8) Two complete training charts are .distributed with the first seven instruc- 
tional packages. One chart is distributed with Instructional Package 8. 

. The administration of a correspondence course can be quite complicated— there are 
many pieces of paper that must be forwarded to and returned by the trainee. Therefore 
as part of. the course a detailed set of <5ourse administrative procedures was developed. 
The major topics covered in this course administr|itive manual included; 

(1) Distribution of instructional packages. ^ 
. " (2) Distribution of reference aids and handbook material. 

(3) Probable time required to study each instructional package. 

(4) Procedures for scoring criterion tests. ^ 

(5) Procedures for scoring pmctical exercises. 

(6) Procedures for distributing, and sequence for distributing: (a) abstract 
- forms; (b) training^ charts; and' (c) handbook material. 



PRODUCTS OF AND ANTICIPATED AUDIENCE FOR 
TUMOR REGISTRAR TRAINING PROGRAM 

At the completion of the present project the following products had been produced 
in either drfirft or final form: 

(1) \A draft training program consisting, of 10 iself -instructional packages, each 

dealing with some aspect of the medical vocabulary and the rules required 
for abstracting the medical chart of a cancer patient. 

(2) A draft version of a Tumor RegistrarJJandbook containing a manual of 
abstracting' procedures plus other informatmn of ,tuse to a tumor registrar. 

(3) A draft version of a manual containing^ classification scheme for extent of 
disease. This manual was developed from a scheme originally developed *by 
Mrs. Paula Baylis and the End Results Group. It has been used in modified 
form by the California Tumor Registry System. 
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Chapter 3 



PREPARATION OF PROGRAM AND SELECTION OF TRAINEES 

SELECTION AND SEQUENCING OF COURSE CONTENT 

The content of this program was selected so as to prepare persons to satisfactorily 
complete, a tumor registry abstract form using End Results Group abstracting/coding 
procedures. Adoption of this general training objective meant that the course had to 
stress ihe application of ERG procedures, and had to teach the skills and knowledges 
required to fill in the specific items on a tumor registry abstract. 

The tumor registry abstract developed for this program contains spaces for recording 
50 items of information. (Section II of the abstract (Biographical/Social/Medical History) 
is shown in Appendix B.) These 50 items are divided into five categories dealing respec- 
tively with: " 

• Patient Identification 

• Biographical/Social/Medical History ^ 
' * Medical Information, Diagnostic and Physical Findings 

• Treatment Information 

• Patient Follow-Through Record 

The instructional content of the course was selected^ so that a trainee would learn 
how to search through a medical chart to locate the information required to complete 
each of the five main sections of the tumor registry abstract. The critical skills and 
knowledges required to perform the abstracting activity are covered m detail in the 
prograixi. These include: 

(1) The capability to arrange the contents of a medical chart in chronological 
order, with similar items (history information, diagnostic information, 

^ doctor's orders, progress notes, etc.) grouped together. I 

(2) The knowledge of the type of information contained on each lype of 
medical record report, sets of notes, and so forth and the skill to sum- 
marize this information in accordance with ERG procedures. 

(3) The knowledge of a basic cancer-related medical vocabulary so that 
appropriate medical chart information can be identified and summarized, 
and in particular so that the difficult-to-read handwriting, typically found 
in a medical chart, can be comprehended. 

(4) The capability to use tumor registry reference material so that decisions 
can reliably and accurately be made regarding what information should be 

. recorded in the various blocks of the tumor registry, abstract. 
The general sequence for presenting the course content was as follows: The first two 
instructional packages contain a broad overview of the purposes, functions, activities, and 
products^of a tumor registry. The purpose of this material is to provide the trainee with a 
broad context for understanding the detailed abstracting and patient follow-through rules 
presented in subsequent instructional packages. Also, the first two instructional packages 
are designed to provide the trainee with the information to answer the many general 
' types of questions which lay persons ask about the diagnosis and treatment of cancer and 
about the purpose of a cancer registry- 
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Instructional Piiekages 3-9 teach abstracting activities in the sequence in which T;hey 
are usually performed by a tumor registrar. During this instruction, the functional 
context approach to instructional sequencing is used. Essentially, this approach involves 
presenting instructional material at the time when it is first required in order to perform 
an activity. 

A tumor registrar performs a number of tasks not directly related to abstracting a 
medical chart. Some of these are discussed in Instructional Package 10. In presenting this 
material, considerable use is made of outside references. Instructional Package 10 contains 
discussions of the general procedures for coding tumor registry abstracts, the general 
procedures for preparing tumor registry reports, and the general procedures for estab- 
lishing and operating a tumor registry. 

PREPARATION OF INSTRUCTIONAL MATERIAL: GENERAL APPROACH 

Any job position has certain characteristics that either simplify or complicate the 
prepawttlon of instructional material for that position. For the tumor registrar, abstracting 
activities are fairly well structured in that a specific and quite detaUed abstract can be 
prepared. The nature of this abstract, particularly if it is in detail, defines quite precisely 
the nature of the abstracting activity and the related training program. A detailed abstract 
was developed for this program and this step greatly simplified the selection, sequencing, 
and preparation of the instructional material. 

Various procedures and rules have been developed for abstracting and coding tumor 
registry information. The most sophisticated of these has been developed by the End 
Results Group of the National Cancer Institute. To use ERG coding procedures reliably, a 
medical chart has to be carefully abstracted to ensure •that the abstract contains all the 
information required to select from among various coding category alternatives. The 
decision to teach ERQ abstracting procedures meant that the training program had to 
teach procedures much more complicated than those used by many existing tuixior 
registries. This decision was made because it was judged that ERG procedures are more 
useful than other sets of simpler procedures, and are the ones that should be employed at 

jtumor registries--assuming that there is a feasible means for teaching the procedures to 

/registry personnel. 

The general procedures for preparing the instructional material first involved gather- 
ing and reviewing material that had already been prepared by other registries and by the 

■ ERG. Whenever possible, portions of this material were incorporated into the training 

■ program. Considerable use was made of material from the ERG Coding Manual of 1967. 
, In numerous instances, additional, material was prepared to further explain this 
) "borrowed" material. ' i 

The initial rough draft of the iq,^ructional material was prepared by subcontractor 
personnel and reviewed for medic^^iorrectnejjs by a technical consultant provided by the 
prime contractor (Charity Hospital, New Orleans, Tumor Registry). The material was then 
reviewed by the director and a key staff member of the Charity Hospital Tumor Registry 
who concentrated on identifying and suggesting rewrites for portions of the material in 
conflict with their interpr€^tation of ERG procedures. This corrected material was then 
returned to the subcontractor. It was rewritten ais suggested by the technical consultants 
and then underwent editorial review. The material then was printed, put in instructional 
packages, and forwarded to the Technical Monitor of the program. 

• When time permitted, the instructional materistl was presented to one or two senior 
high school students wha studied the material and identified portions that were difficult 
for them to comprehehd. These portions were then rewritten. 



experimental program and asked whether they had one or more persons on their staff 
who wished to participate in the program. More than 60 persons asked to participate in 
the original program. Of those finally selected, all but one was associated with a medical . 
care institution. Most of those selected were not familiar with the operation of a tumor 
regislxy. 

Of the 33 experimental students, 32 had no formal medical training; 16 had worked 
in the records department of a hospital but never in a tumor registry, and 7 had worked 
in a tumor registry. Two of the students had a BA degree; all students had graduated 
from high school. All but one of the tarainees were Women, ranging in age from 17 to 57. 
It was judged that this group of trainees was typical of persons who might be available 
for employment as tumor registrars. Useable data were obtained from 31 of the 33 
students. 



The course was completely^adnunistered as a correspondence course to four groups 
of students. The first group began study of the program on 19 July 1971. At one- or 
two-week intervals, additional groupe of students started study of the prograhi. The first 
group of .seven students met in New Orleans to initiate the prograqi. They received a 
short briefing on the intent of the program. 



PROGRAM ADMINISTRATION 
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chapter 4 

RESULTS AND EVALUATION OF THE TRAINING PROGRAM 



This section contains a discussion of the results of the criterion tests, and the 
average time required by a student to study the instructional packages and to take the 
criterion tests. Table 1 summarizes the key findings for each of the instructional packages 
and for the training program as a whole. 



CRITERION TEST RESULTS 

For each of the ten criterion tests a scoring key was prepared. The maximum score 
for ^ach criterion test was arranged to total 100 points. The scoring key and scoring 
instructions for each criterion test were 'incorporated into the course administrative 
manual. An attempt was made to be explicit enough so that persons with little cancer- 
related knowledges could score the test items. 

Table 1 contains a summary of the criterion test scores for each instructional 
package. Some of the more important findings contained in Table 1 are as follows: 

(1) Twenty-seven trainees (88%) scored 70 or above on eight of ten instruc- 
tional package criterion tests. 

(2) Tha highest overall criterion test scores were obtained for criterifiijtests 1 
and 2. 

(3) The lowest overall criterion test scores were obtained for priterion tests 3 
and 10. 



Table 1 

Criterion Test Scores Obtained During Field Test of 
Tumor Registrar Training Program 

(Maximum Score Per Criterion Test ^ 100; N ^ 31} 



Criterion Teit 



1 


2 


3 


4 


5 


6 


7 


8 

1 ^ 


/ 

/ 9 


10 


Median Score 


88.8 


86.5 


71.8 


74.3 


71.5 


73.6 


70.9 


8 lib 


70.9 


62.5 


1st Quartile Score 


83.0 


91.8 


66.0 


80.0 


78.2 


76.7 


75.9 


84.5 


77.4 


48.5 


3rd Quartile Score 


92.0 


96.9 


76.0 


83.1 


81.5 


78.2 


82.4 


88.0 


85.0 


73.7 


Range 






















Minimum Score 


68 


77 


62 


57 


57 


68 


55 


74 


56 ' 


25 


Maximum Score . 


100 


100 


90 


89 


95 


94 


91 


93 100 


88 


Percentage of Scores 






















Below 70 


3.2 


0.0 


38.6 


6.4 


19.3 


3.2 


12.9 


0.0 


22.5 


60.9 


Below 65 


0.0 


0.0 


16.1 


3.2 


6.4 


0.0 


3.2 


0.0 


3.2 


57.7 
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INTERPRETATION OF CRITERION TEST SCORES 

Instructional Packages 1 and 2 ^dealt mostly with the general purposes and 
operations of a tumor registry. The criterion tests for these two packages did Aot contain 
questions involving the actual abstracting of medical chart material. It must be concluded, 
therefore, that the students had more difficulty on abstracting test items than on 
non-abetracting items. An analysis of the criterion test scores for the other Instructional 
Packages bears out this general conclusion. 

Most students had special difficulty with the criterion test for Instructional Package 
3. This was due primarily to their difficulty in organizing a medical chart, and to the use 
in the criterion test of a medical chart (Training Chart #6) that was very difficult to 
abstract. Comments provided by the students, as well as an analysis by the consultants 
and course developers, indicated that the students had been asked to organize an 
unusually difficult medical chart. There is also reason to believe that this particular task 
should be taught in a later portion of the training program; the students would then be 
familiar with the various sections of a medical chart and would be in a position to more 
easily learn how to organize these sections. 

In .Instructional Packages 3 and 4, the trainees were first introduced to the pro- 
' cedures for abstracting a medical chart. Most of the students were not too familiar with 
medical charts, and therefore had difficulty mastering the instructional points contained 
in these two instructiona/packages. In subsequent packages, this difficulty lessened, as 
reflected by#^a general indlfease in the criterion test scores. This seems to' be simply a case 
of the student, with experience, acquiring increased facility at working with a medical 

chart. • V • 1 n 1 

The students scored especially poofly on the criterion test for Instructional Package 
10. At least two rea^sons were identified to account for this poor performahce. One of 
these, the use of Training Chart #6, has been discussed. A second contributing factor was 
that toward the end of the experimental training program 16 students had yet to 
complete criterion test 10. Moreover 9 of these students had. not completed criterion test 
9. These "tardy" students were contacted by the Project Coordinator and asked to 
complete the program as rapidly as possible. This request was successful in that all 16 
students contacted did rapidly complete the program, but their criterion test scores 
suffered significantly. - * * 

(1) For those 15 students who completed' the training program without special 

prodding: 

• Their median score for criterion test 10 was 69.0 

• Their scores ranged frqm 50 to 88. 

(2) For those 16 students who completed the program after prodding: 

• Their median score for criterion test 10 was 54.0. 

• Their scores ranged from 25 to 80. 



AVERAGE TIME TO STUDY INSTRUCTIONAL MATERIAL AND c \ 

COMPLETE CRITERION TESTS . ' , 

Tabie 2 shows the average time in hours and minutes to study each Instructional 
Package and to complete each criterion test. The two median times for each Instructional 
Package have been summed to obtain an estimate of the total time required to study and 
complete the test for each Instructional Package. The data in Table 2 indicate that: 

(1) It took approximately 10 hours and 45 minutes, on the average, to study 
the material contained in a single Instructional Package. 
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(2) It took approximately 4 hours to complete a criterion test. 

(3) The average student required approximately J 50 hours to complete the 
instructional program. 

Table 2 . 



Times Required to Study Each Instructional Package and 
Complete Each Criterion Test 











Instructional Packsg* 










1 


2 


3 


4 


5 


6 


7 


a 


9 


10 


Median time to 






















study instruc- 






















tional material 


9:00 


8:00 


11:30 


9:45 


14:00 


10:0a 


12:15 


11:30 ' 


9:30 


14:00 


Median time to 












\ 










complete 






















criterion test 


1:45 


2:30 


4:15 


3:00' 


6:00 


4:00 


4:00 


4:00 


5:00 


3:00 


Median time to 












\ 








study material 






















and complete 


















* 

X.;' 


test 


10:45 


10:30 


15:45 


12;^5 


20:00 


14:00 


16:15 


15:30 


14:30 


17:00 



■rim* listad In hours and minutes: 1 :45 « 1 hour and 45 minutai. 



The time required to study an instructional package can be controlled by varying 
the number and complexity of the practical exercises. Originally it had been estimated 
that it would take an average of 10 hours to complete each Instructional Package. The 
^ results show that it takes approximately 15 hours. As of this writing there seems to be 
no easy way of reducing the time required to study the program Without at the same 
time reducing the quality of the program. 

The length of training programs can most readily be reduced, virithout causing undue 
f harm, by eliminating portions of the program which are judged to be "nice to know" 
rather than "need to know." With respect to the present program, those sections of 
material describing the systems of the body might be judged by some to be unnecessary 
to the job of a tumor registrar. There is.no question but that a knowledge of systems of 
the body, especially the anatomy of these systems, can be of considerable value to a 
tumor registrar, but it is probable that a tumor registrar can perform to minimum 
standards without this information. 

Judged Success of the Training Program 

This program was satisfactorily completed by 31 students who were judged to be 
typical of those persons for whom the program was developed. The program as it exists 
currently is judged to be effective; it can teach persons with little or no medical training 
how to abstract the medical chart of a cancer patient. 

However, the criterion test scores and the comments of the students indicated that 
the program contained two major flaws in need of correction. These were: 

(1) The training charts were very difficult to read (in the final program they 
would have to be re-written so that legible copies could be produced). 

(2) Training Chart #6, the chart used for; criterion test 3 and 10, is very 
difficult and confusing. This led to the* low scores on these two criterion 
tests. (In the final program two simpler charts might be substituted for 
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Chart #6 in the criterion tests. Chart #6 could be reviewed in the body of 
the instruction material, and used in the practical exercises of IP-3 and 
IPJLO). ' \ 

The above actions should improve the criterion test scores for IP-3 and IP-10. However, 
the time to study and take the test for these two IPs probably will not change 
^significantly. 
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Chapters ^ ^ 

GENERAL PROCEDURES FOR \ 
REVISING DRAFT TRAINING PROGRAM MATERIAL 

The results of the field tryout ^f the first draft of the training prograp indicated 
that the program could be used to train people to perform to minimally acceptable 
standards. They also/^ showed that \the progrfon could be considerably improySw|i.by 
incorporating trainee suggestions and the recommendations of project confiultantk and 
program reviewers. Accordingly, the program was revised, using standard procedutes^; 
these are straightforward, but time-consuming. They include the following 'major sieps: 

(1) Examine the criterion test scores for each major instructional unit to 
determine whether a high percentage of trainees scored well on the test. If they did, 
examine each item of the criterion test to determine whether a small number of items 
were consistently missed by the trainees. If they were: ^ 

A (a) Compare the test item with the related instructional material. Are the 

' two clearly related? Does the instructional material present all the 

infonnation required to pass the test item? Migftt the tr^ftnee require 
more practice in applying the instructional material before tftking the 
\ test? Do the comments pf the trainees, reviewers, consultants suggest 

^ that the test item or its associated instructional material is ambiguous? 

(b) Answers to the above and related questions can usually point the way . 
to improving the instructional material, the test item, or both. The 
material should then be reviewed by content experts to determine 
whether, in th6ir judgment, it has been improved. 

(c) Plans should be made to collect and examine test- data during the next 
administration of the training program to determine whether the 
revised course material leads to higher test scores. 

(2) Examine each major instructional unit to see if the criterion scores for thS^ 
unit are high. 'If they are not, review all comments, test data, etc., related to that unit to 
determine its pedagogical faults. Revise the instructional material and test items as 
appropriate. Remember also, that the original instructional material and test items may 
be adequate in themselves; consider whether more practical exercise material is needed to 
supplement them. * 

(3) Prior to the initial field-test of a prograni, develop a definition of what 
constitutes a satisfactory instructional unit. This definition may contain a variety of 
elements, to include: (a) time required to stndy the unit; (b) cost of presenting the unit 
in tenhs of instructor time, equipment requirements, etc.; (c) the percentage of trainees 
who pass the criterion test for the unit; and .(d) the criterion test score that separates 
acceptable from unacceptable test performance. A rather common criterion is that 90% 
of thfertrainees should obtain a score of 90 or better on each* criterion test. Admittedly, 
this criterion is rather strict. However, after ''a program has been /tested, revised, and 
retested a number of times most trainees should score very highly on the program 
criterion tests. 



(4) In addition to revising a program in line with student comments and test 
8cote$^ review and revise the program according to the suggestions of those groups that 
are to use the program or are interested parties in its use. This very important step in the 
development of a training program helps to increase the probability that the final 
prograih will be acceptable to and adopted by persons and organizatioiis for whom the 
program is intended. 
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Appendix A » 
TABLE OF CplsitENTS FOR INSTRUCTIONAL PACKAGE #1 
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Instructional Package 1 
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I PROGRAM DESCRIPTION AND ADMINISTRATIVE PROCEDURES 
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Information' for Tumor "^Regis try ' ^ ' 

Training Program. . . . 1 ..... . 
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Value of a Tumor Registry . » • • • 9» 
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Research Benefit^ of a yumor Rsegistiy 41a 

Test. ........ 46a 
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Departments and Medical Organizations . . . . 21b 
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Hospital Size . ............... 22b 
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Figure 2: Cytology Report ' . 
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Rationale for the Desi'gn and Utilization of 



Tumor Registry Abstract Forms 87 
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V CRITERION TEST . . . 91 
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Appendix B 
TUMOR REGISTRY ABSTRACT 

SECTION n - BIOGRAPHICAL. SOCIAL AND MEDICAU HISTqRY 



Biographical Information ^ 

a. ■ Sex (male, female, unk.) 

b. ' Age at Dx, last-birthday 



d. . 



Date of birth 

4 

Place of birth (Town, 
County & State) 



□ 



□ 



Race 

1 . Caucasian 
. 2. Ntgro 

3. AfTi«r. Indian 

4. Spanish Amar. 

Marital Status _ , 

1. Single 

2. Married 

3. Widow 



5. Chinese 

6. Japanese 

7. Other (specify) 



4. Divorced 

5. Separated 

6. Unknown 



13, 



Female History 
a. Patient is: 

□ 



1. Pregnant i 

2. Premenopausal 

3. Perimanopausal 

4. (Menopause ± 1 yr.) 

5. Menopausal, 1>5 y rs. ' 

6. Minopausal, more than 5 yrs. 

7. Not Applicable 



b. No. of 
Pregnancies 

□ , 



c. No, of 
Births 



□ 



0(Ndne^ 

1 

2 

3 

4 



S 

6 or mora 

nknown) 

i 



i0 



14. 



Referral Source 

. 1, Private Physician 

2. Hospital or Clinic (outside) 

3. Hospital or Clinic (this institution) 
^ 4. Nursing Home 

If 1, 2,4, or 5 above, please specify: 



5. Statutory authority 

6. Self 

7. Other 

8. Unknovyn . 



Name of physiciarvor institution 



Address 



10. 



Occupational History 



15. Was this neoplasm diagnosed bcfdre this admission? 




Major Occupation 
Secondary Occupation 



□ 



1. Ves, this institution 3. No 

2. Yes, elsewhere 4. Unknown 

If "yesv elsewhere" specify name & address of physician 
and/or institution « ^ 



□ 



Present Work Status 

1. Working normally 

2. Semi'retirad 

3. Retired 



4. Disabled 

5. Does not apply 

6. Unknown 



Name of hospital or physician (or unk) 
Diagnosis (site and type) and date 



Method of diagnosis (use No. 24 categories) 
If treatment received, note in item 17 



11. Social History 

1. Alcoholism 



C- Current; P»Pravioys 



No. C/P 



2. Birth control pills 

3. Exposure: industrial toxins 

industrial carcinogens 

4. Smoking: a.* Cigar c. Pipe 

b. Cigarette d. Cannabis 

5. Previous anticancer drugs 

6. Trauma in area of primary tumor 

7. Other , 

8. Unknown 

Describe: ^ 



12. Family History of Cancer: 
a. Relative: 

1. Mother 

a. 

2. Father 

3. Sibling b. 

4. Child 

^ 5. Maternal grandparent * 

6. Paternal grandparent 

7. Other (specify) 



n 



8. None 

9. Unknown 



Site(s) of family cancer: 

1. Breast 

2. Gastroimestina 

3. Lung 

4. Genitourinary 

5. Lymphoma 

6. Leukemia 

7. Other (specify) 

8. Unkjiown 



16. Preyious Neoplasms 



□ 



□ 



e. Record total number of previous occurrences, 
this neoplasm: , 

0 '4 

1 5 

2 6 dr mora 

3 7 (unknown) 

b. Record total number of previous indeptncient 
cancers: 



6 or more 

7 (unknown) 



'c. Record primary site and type for each previous 
independent cancer. If unknown, record as unk. 



(D- 



(2)_ 



EMC 
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SECTION II - BIOGRAPHICAU SOCIAL AND MBDJCAU HISTORY (Continued) 



17, Previpus Treatment * 

a. H as patient received tumor*direct«d treatment for this neoplasm more than 3 months before entry to this institution? 

f~| 2. No ^ 1, Suro«rv 3. Chtmothtrtpy 5. Other 

b. If yes, check types given and describe briefly 2. R«diothtrtpv 4. Hormonts/sttro.ds 6. Unknown 



□ 
□ 
□ 



*NOTE: Any trtatment givtn within thret (3) months before entry should be indicated on tn tppropriatt trettment jsummary m Section TV. 

' ' I — 

SECTION III MEDICAL INFORMATION, DIAGNOSIS AND PHYSICAL FINDINGS 

18. Symptoms 



18a. Significant Symptoms. Describe and record date of onset for thoseT \ 
symptoms which have occurred within one year prior to admission (PTA). 



Checklist: 

1. Changes In bowel or bladder habits. 

2. A sore that does not heal. 

3. Unusual t)leedlng or discharge (presence or absence of). 

4. A lump or thickening— breasts elsewhere. f 

5. Irrdigestion or difficulty swallowing. 

6. Obvious chenges In a wart or mole. ^ 

7. Persistent hoarseness, cough, sore throat. 

8. Weakness or fatigue, fainting spells. 

9. Unexplained weight loss or gain. 

10. Breathing difficulties, shortness of breath. 

11. Other symptoms (define). 

12. No significant symptoms. 

13. Information unavailable. 



1/ ' 18b. General Symptoms. Describe and record date of onset for those symptoms 

which originated witliin thre? (3) months PTA. « . . 

— Checklist: 



m. 
m, 

18c. 



Neurological Symptoms: Describe and record date of onset for those 
symptoms which originated one year PTA. 



m. 
m. 
m. 
m. 
m. 



1. 


None 


22. 


2. 


Angine pectoris 


23. 


3. 


Acromegaly 


24. 


- 4. 


Anorexia 


25. 


5. 


Chills 


26. 


- 6. 


Cough 


27. 


7. 


Diarrhea 


28. 


8. 


Dysphagia 


29. 


- 9. 


Dyspnea 


30. 


10., 


Dyturia 


31. 


► 11. 


Endocrine effect 


32. 


12. 


Fever 


33. 


13. 


Headache 


34. 


" 14... 


Hemeturia 


35. 


15. 


Hemetemesls 


36. 


16. 


Hemoptysis 


37. 


17? 


Hemorrhage 


38. 


18. 


Hirsutism 


39. 


- 19. 


Hoarseness 


40. 


20. 


Lactation 


41. 


21. 


Melena 




Checklist: 




1. 


No neUrologlc symptoms 




2. 


Abnormal coordination 




3. 


Abnormal gait > 




4. 


Memory deficit 




- 5. 


Motor weakness 




6. 


Seizures 




- 7. 


SeTtMiry change 




8. 


Abnormal speech 




9. 


Vtsuaf defect 




10. 


Other (spiecify) 




11. 


Unknown 





Nauiej|_&/or vomiting 

Night Sweats 

Nocturia 

Orthopnea 

Pain 

Pruritus (itching) 
Petechia 
Skin nodules 
Sore throat 
Syncope 

Urinary frequency 
Urinary irritation 
Urinary obstructtoji 
Urinary urgency 
Vaginal bleeding 
Weakness, fatigue 
Weight gain 
^Weight loss 
Other (Cpecify) 
Unknown 
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HUMAN RESOURCES RfeWARCH ORGANIZATION 
aOO.North WMhinilon ttrMt • ^WxamlrM. Virginia 22314 


- 




IPirtHiijNmt 

ExtcMtivt Viet hrMidtnf 

CxHutivd Offictr / 


Dr. Mtradith P, Crawford 
Or. Wiiliam A. McClalianc^ 
Mr. Saul lav'uky 




= 


Oirktor for Bmfmi Affairs It Trttmrir 
DirKtor for f^ofmin Dtv«l#pMitftt 
Dirtcl^ for RttMrdt thv^rt it Htii^ttiiii 


Mr. Charkti W. Smith 
Mr. David S< Buthnatl 
Dr/€ugant A. Cogan 






Dirfctor EcNtorM It fhroductloiv C««t#r 


Mrs. Lola M. Zook 

< 






RESEARCH DIVISION$ 




- ■■ 


HumRRO EwtiTfi DWiiioit 
300 North Wathington $imx 
A^xftndria, Virginia 22314 


Or, J. Daniat Lyont 
Dirtctor 






HhinBRO Oivliloo No. 2 /; 

. Fort Knox, Ktntucky/40121 


Dr. Donald F. Hagoard 
Diractor 






HumRRO yVamm Diviikm 
Poit Off »ct Box 57;|7 
Pratklio of Morrt«|fay. California 93040 


Dr. Howard H. McFanrt 
Dirtctor 






HMmRRODiviiioMlito^ 

Fort •arming. Caor^ia 31906r 


Dr. T,0. Jacobs 
Dirtctor 


1// 




HumRRO OMai0fi No. i 

rVxt Off ice B<>x 42i 

Fort Rucker, Atabama 36360 


Dr. Watlaoa W. Prophat 

Diractor 
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